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SYSTEMS AND METHODS FOR 
IMPLEMENTING SECOND-LINK ROUTING 
IN PACKET SWITCHED NETWORKS 

FIELD OF THE INVENTION 
5 The present invention relates generally to packet switching systems and methods and, 

more particularly, to systems and methods for routing Internet Protocol (IP) traffic between 
local-area networks (LANs) connected via connection-oriented packet switches in mobile ad- 
hoc networks using virtual circuits. 

BACKGROUND OF THE INVENTION 

10 Connection-oriented protocols have conventionally been used for switching packets 

from a source node to a destination node in packet switching networks. Such protocols have 
found acceptance in the mobile arena with network hardware installed in trucks and other 
vehicles or hand-carried. Connections between switches in such environments are often 
short-lived as equipment is moved together or apart, and are of widely fluctuating 

15 throughput quality. The challenge of routing data packets in this environment is substantially 
greater than that of stationary systems. Connection-oriented designs for such systems have 
been favored because of the need to support telephony as well as machine-to-machine 
communications. However, IP has become the protocol of choice for end users of such 
systems, so the need to route IP packets 

20 across mobile, ad hoc switching networks has been met by adding IP routers on top of the 
connection-oriented switches, and developing protocols for establishing the optimal path 
from one router to another. 

The algorithms used by routers to convey connectivity in a mobile network have 
evolved to keep up with the constantly changing topology, and, as the IP addresses 
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themselves will not convey any topological information when a router can move about freely, 
they typically use flooding techniques (sometimes called 'Shortest Path First* algorithms) to 
pass local connectivity information on to more distantly-connected routers. A router then 
uses this information when sending or forwarding packets to another router to decide which 
way to send the packet. Typically a router will determine which of its nearest neighbors is 
'closest' to the destination, and then forwards the packet one hop to the chosen neighbor. To 
do so when the router is attached to a connection-oriented switch, as is the case here, the 
router must select a virtual circuit on which to place the packet. To facilitate this, it is the 
current practice for each switch to automatically set up a permanent one-hop circuit to each 
I \ 10 of its immediate neighbors, with the neighbor forwarding all packets arriving on this circuit 
to its connected IP router. 

When workstations on LANs are attached to a network switch, it is the current 
practice for whatever device is used to bridge between the LAN and the switch (technically a 
gateway) to employ the same technique of forwarding all packets addressed 'off LAN' to the 
15 same one-hop circuit to be forwarded to the IP-router, where the knowledge of the current 
network topology resides. 

The use of multi-hop circuits for faster IP packet transport has faced a number of 
substantial obstacles: Portable equipment lags the stationary world in terms of size and 
speed, and mobile switch equipment usually has sufficient memory only for small Virtual 
20 Circuit (VC) tables. Hence, circuits have to be used selectively. The paths between switches 
are in constant flux in a fast moving mobile environment (as, for example, in military or fire- 
fighting environments), so connections are constantly being broken and re-established. IP is 
not connection-oriented, so setting up connections as packets arrive for some new destination 
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has proved infeasible since the standard protocols for negotiating a virtual circuit across 
multiple hops take substantially longer than TCP timeouts tolerate. Knowledge of breaks in 
connectivity is known first to the switches closest to the break, so packets forwarded by more 
distant routers will often arrive with the expectation of a (now-broken) path to the 
5 destination, and the receiving router must be able to acquire control of the packet, rather 
than have its connected switch forward the packet fixrther down a no-longer-complete virtual 
circuit. 

For traffic between workstations on different LANs attached by gateways to different 
switches (in trucks, etc.), the problem is even more difficult since the gateway device 
10 bridging between the LAN and a router/switch has no knowledge of the network topology. 
Nevertheless, fast communications is a must between workstations in ad hoc networks, and 
there is a real need for better use of the capabilities of the underlying cormection-oriented 
switching network for these communications. 

Therefore, there exists a need for a system and method that can implement multi-hop 
15 virtual circuit paths in a mobile, ad hoc, connection-oriented packet switching network to 
support fast and reliable connectivity of connected LANs. 

SUMMARY OF THE INVENTION 
Systems and methods, consistent with the present invention, address this and other 
needs by assigning virtual circuit identifiers (VCIs) to LAN gateways and distributing the 
20 VCIs to other LAN gateways throughout a network. Distribution of these VCIs permits each 
receiving LAN gateway to implement virtual circuit paths with other LAN gateways in the 
network. 
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In accordance with the purpose of the invention as embodied and broadly described 
herein, a method of distributing virtual circuit identifiers associated with gateways in a 
network includes receiving, at a first node, packets comprising a plurality of first virtual 
circuit identifiers associated with gateways in the network; determining if any of the 
gateways are connected to the first node; assigning second virtual circuit identifiers to the 
connected gateways; and initiating the transmission of a message to the connected gateways 
informing the connected gateways of the plurality of first virtual circuit identifiers. 

In another implementation consistent with the present invention, a method of 
forwarding packets received at a first gateway in a network includes receiving a message at 
the first gateway, the message comprising a plurality of virtual circuit identifiers associated 
with other gateways in the network; receiving packets for transmission from the first gateway 
to a destination address associated with a second gateway; and sending the received packets 
towards the second gateway using one of the received plurality of virtual circuit identifiers. 
BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a part of this 
specification, illustrate an embodiment of the invention and, together with the description, 
explain the invention. In the drawings, 

FIG. 1 illustrates an exemplary network in which systems and methods, consistent 
with the present invention, may be implemented; 

FIG. 2 illustrates exemplary components of a Router/Switch consistent with the 
present invention; 

FIG. 3 illustrates exemplary components of a gateway consistent with the present 
invention; 
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FIG. 4 is an exemplary Switch Virtual Circuit (VC) table for a switch-gateway 
interface 250 consistent with the present invention; 

FIGS. 5 is an exemplary gateway VC table for the switch port consistent with the 
present invention; 

FIG. 6 is an exemplary gateway forwarding table consistent with the present 
invention; 

FIG. 7 is an exemplary router-to-adjacent-router update packet consistent with the 
present invention; 

FIG. 8 is an exemplary router-to-router gateway-flood-update packet consistent with 
the present invention; 

FIG. 9 is an exemplary router-to-gateway update packet consistent with the present 
invention; 

FIG. 10 is a flowchart that illustrates exemplary router gateway-flood-update 
processing consistent with the present invention; 

FIG. 1 1 is a flowchart that illustrates exemplary gateway processing of packets from 
LAN consistent with the present invention; 

FIG. 12 is a flowchart that illustrates exemplary gateway processing of packets from 
switch consistent with the present invention; and 

FIG. 13 is a flowchart that illustrates exemplary switch processing of packets from 
gateway consistent with the present invention. 

DETAILED DESCRIPTION 

The following detailed description of the invention refers to the accompanying 
drawings. The same reference numbers in different drawings identify the same or similar 
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elements. Also, the following detailed description does not limit the invention. Instead, the 
scope of the invention is defined by the appended claims. 

Systems and methods consistent with the present invention provide mechanisms that 
assign VCIs to LAN gateways and distribute the VCIs to other LAN gateways throughout a 
5 network. Distribution of these VCIs permits each receiving LAN gateway to implement 
virtual circuit paths with other LAN gateways in the network. 

EXEMPLARY NETWORK 
FIG. 1 illustrates an exemplary network 100 in which systems and methods, 
consistent with the present invention, may be implemented. Network 100 may include 
10 multiple routers, each router interconnected with another router by conventional links. For 
purposes of illustration, FIG. 1 shows router/switches Rl 105, R2 1 10, R3 1 15, R4 120, R5 
125 and R6 130 interconnected by links 155. One skilled in the art will recognize that a 
typical network may include fewer or greater numbers of routers than those shown in FIG. 1. 
Network 100 may further include gateways interconnected with one or more of the 
15 routers of the network. For purposes of illustration, FIG. 1 shows gateways 135 and 140 

connected with routers Rl 105 and R6 130, respectively. Each gateway may further connect 
with a local-area network (LAN). For example, gateways 135 and 140 may connect to LANs 
145 and 150, respectively. LANs 145 and 150 may include one or more networks using any 
type of multi-access media, including, for example, an Ethernet or a token ring network. One 
20 or more conventional workstations, such as workstations 160a - 160d, may further 
interconnect with each LAN. 

EXEMPLARY ROUTER 
FIG. 2 illustrates an exemplary router/switch Rl 105 that may route packets in a 
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manner consistent with the present invention. Router/switches 1 10 - 130 may be similarly 
configured. Router/switch Rl 105 may include an IP-router processor 205, a router memory 
210, a switch memory 215, a switch processor 220, a switch-router interface 225, port 
interfaces 230, 235, 240 and 245, and switch-gateway interface 250. 

IP-router processor 205 may execute instructions for performing IP routing 
algorithms and can include a conventional processing device. Switch processor 220 may 
execute instructions for performing, among other functions, virtual circuit path switching and 
can include a conventional processing device. Router memory 210 may provide permanent, 
semi-permanent, or temporary working storage of data and instructions for use by IP-router 
processor 205. Switch memory 215 may provide permanent, semi -permanent, or temporary 
working storage of data and instructions for use by switch processor 220. Router memory 
210 and switch memory 215 may include conventional data storage devices, such as, for 
example. Random Access Memory (RAM) or Dynamic RAM (DRAM). 

Switch-router interface 225. may include conventional mechanisms for interfacing IP- 
router processor 205 with switch processor 220. Port 0 interface 230, port 1 interface 235, 
port 2 interface 240 and port 3 interface 245 may each include conventional mechanisms for 
interfacing router 105 with network 100 via links 155. Switch-gateway interface 250 may 
include conventional mechanisms for interfacing router 105 with one or more gateways, such 
as gateway 135. 

EXEMPLARY GATEWAY 
FIG. 3 illustrates an exemplary gateway 135 that may receive and forward IP packets 
to and from LAN 145 consistent with the present invention. Gateway 140 may be similarly 
configured. Gateway 135 may include a switch interface 305, a memory 310, a LAN 
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interface 315 and a processor 320. 

Switch interface 305 may include conventional mechanisms for interfacing gateway 
135 with a packet-switch, such as router/switch 105. Memory 310 may provide permanent, 
semi-permanent, or temporary working storage of data and instructions for use by processor 
320. Memory 310 may include conventional data storage devices, such as, for example, 
RAM or DRAM. LAN interface 315 may include conventional mechanisms for interfacing 
gateway 135 with a LAN, such as LAN 145. Processor 320 may execute instructions for 
forwarding packets to and from a connected switch or a connected LAN in a manner 
consistent with the present invention. Processor 320 may include a conventional processing 
device. 

EXEMPLARY ROUTER VC TABLE 

FIG. 4 illustrates an exemplary switch Virtual Circuit (VC) table 400, consistent with 
the present invention, that may be stored in switch memory 215 for the switch-gateway 
interface 250 of router/switch 105. Switch VC table 400 may include VC entries 405 
containing a switch output port (PN^ut) 410 and an outgoing virtual circuit identifier (VCI^^^ 
415. Switch VC entries 405 may correspond to incoming VCIs contained in received packet 
headers. A Switch VC entry 405 may include a switch output port {PN^J) 410 through which 
to forward a packet, and it may also include an outgoing virtual circuit identifier {VCI^^) 415 
that is to be placed in an outgoing packet header in place of an incoming VCI {VCIi„), 

EXEMPLARY GATEWAY VC TABLE 

FIG. 5 illustrates an exemplary gateway VC table 500, consistent with the present 
invention, that may be stored in memory 3 10 of each gateway in network 100. VC table 500 
may include VC entries 505 containing a destination 510. VC destinations 510 may include 
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the gateway processor and the LAN. VC entries 505 may exist for 'Hello' protocol 
messages, 'Route' protocol messages, and packets intended for the LAN. For example, entry 
one might be designated as the 'Hello' protocol entry number, entry two might be designated 
as the 'Route' protocol number, and three might be designated as the entry number for all 
5 packets intended for a workstation connected to a gateway LAN, such as LAN 145. 

EXEMPLARY GATEWAY FORWARDING TABLE 
FIG. 6 illustrates an exemplary gateway forwarding table 600, consistent with the 
present invention, that may be stored in memory 210 of each router in network 100, such as 
router Rl 105, and in memory 310 of each gateway in network 100. Forwarding table 600 
10 may include destination gateway entries 605 and outgoing virtual circuit identifier entries 
{VCI^J) 610. Destination gateway entries 605 may include entries indicating destination 
gateways in network 100 that the gateway storing forwarding table 600 may be able to reach. 
VCI^^i entries 610 may include outgoing virtual circuit identifiers that correspond to each 
destination gateway 605. FC4„, entries 610 for different destination gateways may or may not 
15 be distinct, depending on the connected router's decision logic and its understanding of the 
network topology. 

EXEMPLARY ROUTER-TO-ADJACENT 
ROUTER UPDATE PACKET 

FIG. 7 illustrates an exemplary packet 700, consistent with the present invention, that 
20 may be used by a router in network 100, such as router Rl 105, to inform neighboring routers 
of gateways connected to router Rl 105. Packet 700 may include a router number 705, a 
sequence number 710, gateway state data 715, and gateway VCI data 720. 

Router number 705 may include a number that identifies the router sending the update 
packet. Sequence number 710 may provide an indication of the version of packet 700 sent 
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from the router identified by router number 705. For example, older versions of a packet sent 
from router 105 may have lower sequence numbers than newer versions of the tag update 
packet. Gateway state data 715 may include data indicating whether gateways connected to 
router 105 are operational or non-operational. Gateway VCI data 720 may include data 
identifying the VCI(s) assigned by router 105 to gateways connected to router 105. Gateway 
VCI data 720 may be used by another router in the network to fashion a virtual circuit whose 
last two links are into some port of the router's switch, and then out of the switch toward the 
gateway. To this end, the router may set the VC Table entry assigned for the gateway to have 
Pn,,, = SWITCH-GATEWAY INTERFACE 250 and VC^ = /P #, the entry number for all 



n i 10 packets intended for a workstation connected to the gateway LAN. This allows the other 
^ I router to form a virtual circuit terminating at this router's gateway for use in fast switching 



the other router's gateway's packets to this gateway. 

EXEMPLARY ROUTER FLOOD 
UPDATE PACKET 

I 15 FIG. 8 illustrates an exemplary packet 800, consistent with the present invention, that 

j may be used by a router in network 100, such as router Rl 105, to inform other routers in the 

I 

network of gateways in network 100. Packet 600 may include a router number 805, a 

sequence number 810, gateway identifiers 815, and gateway data 820. 

Router number 805 may include a number identifying the router sending the packet. 

20 Sequence number 810 may provide an indication of the version of packet 800 sent from the 

router identified by router number 805. For example, older versions of a packet sent from 

router 105 may have lower sequence numbers than newer versions of the tag update packet. 

Gateway identifiers 815 may identify addresses associated with gateways in network 100. 

Gateway data 820 may indicate up/down state, characteristics, IP address ranges, or any other 
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information that the routers find useful. 



EXEMPLARY ROUTER-TO-GATEWAY 
UPDATE PACKET 



FIG. 9 illustrates an exemplary packet 900, consistent with the present invention, that 
may be used by a router in network 100, such as router Rl 105, to inform a connected 
gateway of VCIs assigned to other gateways in network 100, so that the gateway may keep 
its gateway forwarding table 600 consistent with the router's. Packet 900 may include a 
sequence number 905, gateway identifiers 910, gateway VCIs 915 and add/drop flags 920. 

Sequence number 905 may provide an indication of the version of packet 900 sent 
from the router connected to a gateway. Gateway identifiers 910 may include addresses 
associated with gateways in network 100. For example, older versions of a packet sent fi"om 
router 105 may have lower sequence numbers than newer versions of the update packet. 
Gateway VCIs 915 may include VCIs for each connected gateway to use to reach gateways 
identified by gateway identifiers 910. Add/drop flag 920 may include status indicators that 
indicate whether gateways identified by gateway identifiers 910 should be added to or 
removed from gateway forwarding table 600. 



FIG. 10 is a flowchart that illustrates exemplary processing, consistent with the 
present invention, for updating the entries in VC table 400. As one skilled in the art will 
appreciate, the method exemplified by FIG. 10 can be implemented as a sequence of 
instructions and stored in switch memory 215 of router/switches in network 100, such as 
router/switch 105. 

To begin processing, router 105 receives update packets 700 and/or 800 fi-om 



EXEMPLARY ROUTER VC TABLE 
UPDATE PROCESSING 
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neighboring routers (e.g., R2 1 10, R3 1 15) [step 1005]. From the received packets, router 

105 determines if there are any new gateways in network 100 [step 1010]. If so, router 105 

assigns and sets VC entry 405 in switch's gateway-node VC table 400 for each new gateway 

connected to network 100 [step 1015] and updates its gateway forwarding table 600. If there 

are no new gateways in network 100, router 105 determines if any previously existing 

gateways have been disconnected or are down [step 1020]. If not, processing proceeds to 

step 1030. If any previously existing gateways are down, or if their routers have been 

disconnected, router 105 adjusts the VC entry 405 in VC table 400 for each gateway down or 

disconnected, setting the router output port entry 410 to '"'IP-router'' and setting the VCI^^ 

415 to # so that packets arriving from the gateway with this VCI are sent to the IP Router 

by its switch for processing [step 1025]. Router 105 may then send a packet 900 to any 

connected gateway informing the connected gateway of changes to VCIs that the connected 

gateways may use to reach other gateways connected to other routers in network 100 [step 

1030]. Each connected gateway, such as gateway 135, updates <Destination Gateway, FC4„, 

> entries 610 in its gateway forwarding table 600 with the Gateway 910 and gateway VCI 

915 values received in packet 900 [step 1035] in order to keep its gateway forwarding table 

600 in sync with that of its router. 

EXEMPLARY GATEWAY 
PACKET FORWARDING PROCESSING 

FIG. 1 1 is a flowchart that illustrates exemplary processing, consistent with the 

present invention, for forwarding packets received at a gateway in network 100, such as 

gateway 135, from a connected router/switch, such as router/switch 105. As one skilled in 

the art will appreciate, the method exemplified by FIG. 1 1 can be implemented as a sequence 

of instructions and stored in memory 3 10 of gateways 135. 
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To begin processing, gateway 135 may receive a packet from router/switch 105 [step 
1 105]. Gateway 135 may then read the incoming VCI (VCIfj^) from the packet header [step 
1 1 10]. Gateway 135 may determine if VCIj^f is equal to the *Hello* protocol entry number 
[step 1115]. If so, gateway 135 processes the received packet in the conventional fashion for 
5 'hello' or 'keep-alive' protocols (which are used to determine the up/down state of an 
attached device)[step 1 120]. If not, gateway 135 may determine if VCIi^ is equal to the 
'route number' [step 1 125], If so, gateway 135 processes the received router-to-gateway- 
update packet 900 and updates its gateway forwarding table 600 from data in packet 900 
[step 1 130], If not, gateway 135 may determine if VCIj^ is equal to the IP number [step 

10 1 135]. If so, gateway 135 removes the switch-packet header containing the VCIj^^ from the 
packet [step 1 140] and forwards the packet to LAN 145 [step 1 145]. If VCIj^^ is not equal to 
any of these numbers (typically 1, 2, and 3 respectively), then gateway 135 may discard the 
packet as being of an unknown type [step 1 150]. 

FIG. 12 is a flowchart that illustrates exemplary processing, consistent with the 

15 present invention, for forwarding packets received at a gateway in network 100, such as 
gateway 135, from a workstation connected to a LAN, such as LAN 145. As one skilled in 
the art will appreciate, the method exemplified by FIG. 12 can be implemented as a sequence 
of instructions and stored in memory 310 of gateway 135. 

To begin processing, gateway 135 may receive a packet sent from a workstation, such 

20 as workstation 160a, across LAN 145, the packet containing a destination IP address that 
resides outside of LAN 145 [step 1205]. Gateway 135 may determine if the destination IP 
address is associated with a gateway in its gateway forwarding table 600 [step 1210]. If not, 
gateway 135 can insert the customary default # VCI [typically the number "1"] in the 
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packet header [step 1225] so that the switch, on receiving the packet, will forward it to its 

router for customary processing. If gateway 135 determines that the destination IP address is 

associated with a gateway in its gateway forwarding table 600, gateway 135 can retrieve a 

VCI^^f 610, associated with the gateway, from the gateway VCI table 600 [step 1215]. 

5 Gateway 135 may then insert FC4„, 610 in the packet header [step 1220]. 

At step 1230, gateway 135 can forward the received packet to switch 105. 

EXEMPLARY ROUTER 
FORWARDING PROCESSING 

FIG. 13 is a flowchart that illustrates exemplary processing, consistent with the 

^rf ( 10 present invention, for forwarding packets received at a switch in network 100, such as switch 

105, from a gateway, such as gateway 135, connected to its a switch-gateway interface 250. 

As one skilled in the art will appreciate, the method exemplified by FIG. 13 can be 

implemented as a sequence of instructions and stored in switch memory 215 of router Rl 

105. 

15 To begin processing, router/switch Rl 105 may receive a packet from switch-gateway 

interface 250 [step 1305] and then may inspect the packet's incoming VCI (VCIJ in the 
packet header [step 1310]. Router Rl 105 may fiirther determine an output port number 
(PN^J 410 from VC entry 405, corresponding to of switch-gateway interface 250 VC 
table 400 [step 1315]. Router Rl 105 may then determine an outgoing VCI (VCI^J 415 from 
20 VC entry 405, corresponding to FC4, of VC table 400 [step 1320]. Router Rl 105 can 

replace FC4 in the packet header with the determined FC4„, 415 [step 1325]. Router Rl 105 
may then forward the packet to PN^^^ 410 (either an output port or IP-router 205 [step 1330], 
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CONCLUSION 

Systems and methods consistent with the present invention provide mechanisms that 
assign virtual circuit identifiers to LAN gateways and distribute the VCIs to other LAN 
gateways throughout a network. Distribution of these VCIs permits each receiving LAN 
gateway to implement virtual circuit paths with other LAN gateways in the network. 

The foregoing description of exemplary embodiments of the present invention 
provides illustration and description, but is not intended to be exhaustive or to limit the 
invention to the precise form disclosed. Modifications and variations are possible in light of 
the above teachings or may be acquired from practice of the invention. For example, while 
certain components of the invention have been described as implemented in hardware and 
others in software, other configurations may be possible. Also, while series of steps have 
been described with regard to FIGS. 10-13, the order of the steps may be altered in other 
implementations consistent with the present invention. No element, step, or instruction used 
in the description of the present application should be construed as critical or essential to the 
invention unless explicitly described as such. The scope of the invention is defined by the 
following claims and their equivalents. 
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